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(54) Image pickup system and picked-up image signal processing apparatus 



(57) In an image pickup system, an image pickup 
unit is connected to a computer which has a display de- 
vice. In order to make a display by matching the char- 
acteristic of the image pickup unit with that of the display 
device, the image pickup unit is provided with a control 
part which is arranged to measure a signal processing 



speed of the computer, to compare the signal process- 
ing speed with an image pickup speed or a picked-up 
image data output speed of the image pickup unit and 
to vary an image pickup action or a picked-up image da- 
ta output action of the image pickup unit according to a 
result of the comparison or according to an operation 
performed by an operator of the image pickup system. 
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Description 

Background of the Invention: 
s Field of the Invention: 

The present invention relates to an irnage pickup system in which an innage pickup unit is connected for use to an 
external apparatus arranged to process images. 

10 Descriptbn of the Related Art: 

Computers having connection terminals of the PCMCIA standards are generally arranged to be usable with card- 
shaped units of various functions inserted therein as a facsimile, a memory, etc. The connection terminal permits use 
of each of the various card-shaped units by replacing one with another so long as they meet the PCMCIA standards. 
15 The connectbn terminal thus permits selective use of card-shaped units of various functions as desired by the operator. 

Fig. 7 shows by way of example an Image pickup system which is composed of a computer having the above- 
stated connection terminal and an image pickup unit which is removably attachable to the computer 

The illustration of Fig. 7 includes a card-shaped image pickup unit 21 , computers 22. 24 and 26 which are usable 
in the innage pickup system, and connection terminals 23, 25 and 27 which are respectively arranged to connect the 
20 innage pickup unit 21 to the computers 22, 24 and 26. A case where the image pickup system is formed by connecting 
the image pickup unit 21 to the connection terminal 23 is first described as follows. 

Referring to Fig. 7, an image is picked up by an optical system and a CCD which are included in the image pickup 
unit 21 . The image picked up is converted into digital image data. The picked-up image data thus obtained is transferred 
through the connection tenninal 23 to the computer 22 at a predetermined speed. 
25 The image pickup unit 21 sends the picked-up innage data which includes a color signal to the computer 22 at a 

rate of n frames per sec. The computer 22 then processes the n-frames/sec picked-up image data sent from the image 
pickup unit 21 and is capable of displaying the picked-up image data on a built-in color display device or recording the 
picked-up innage data in a built-in recording device. 

The use of the computer 22 may be replaced with the use of the computer 24. The computer 24 is provided with 
30 the connection terminal 25 which conforms to the same standards as the connection terminal 23 of the computer 22 
and a color display device which is similar to that of the computer 22. 

Since the connection terminal 25 is of the same specifications as the connection terminal 23, the image pickup 
unit 21 can be connected to the connection terminal 25. With the innage pickup unit 21 connected to the connection 
terminal 25, the computer 24 displays and records the picked-up image data obtained from the image pickup unit 21 
35 in the same manner as when the image pickup unit 21 is connected to the computer 22. 

The operator of the image pickup system can use either the computer 22 or the computer 24 and also can use the 
image pickup unit 21 in common with them. 

This arrangement of the image pickup system, however, has presented the following problems. 

In the image pickup system shown In Fig. 7, a case where the computer 26 is used will be considered. The computer 
40 26 has a less amount of consumption of electric power and less weight than the computers 22 and 24, but has a slower 
processing speed than the computers 22 and 24 and has only a monochrome display device instead of a color display 
device. 

Since the connection terminal 27 also conforms with the same standards as the connection terminals 23 and 25, 
the computer 26 is capable of exchanging data with the image pickup unit 21 as connected to the connection terminal 
45 27. However, since the processing speed of the computer 26 is too slow, it is Impossible to completely process the 
picked-up innage data being sent from the image pickup unit 21 . As a result, the picked-up image data tends to be lost 
in part or an image pickup operation sometimes comes to a stop. 

Besides, in such a case, it Is impossible to utilize color information Included in the picked-up image data sent from 
the image pickup unit 21 as the computer 26 Is provided with only a monochrome display device. 

50 

Summary of the Inventbn: 

The present invention is directed to the solution of the above-stated problem of the prior art. It is, therefore, a 
concern of the invention to provide an Image pickup system which is composed of at least one image pickup unit and 
55 at least one computer and a picked-up image signal processing apparatus, which are capable of utilizing the charac- 
teristics and perfornnance of the computer to a maximum extent and also capable of solving the problems caused by 
a difference in data processing speed and in display device between one computer and another 

Thus an embodiment of an image pickup system according to the invention may be configured as follows 
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(1) An image pickup system is composed of an image pickup unit which has a connection terminal for connection 
with an external apparatus and which is arranged to pick up an image to output picked-up image data from the 
connection terminal and at least one external apparatus which is connected to the image pickup unit. The Image 
pickup unit comprises data exchange means for exchanging data with the external apparatus connected, process- 

5 ing-speed detection means tor measuring or predicting a processing speed of the external apparatus connected, 

speed comparison means for making a comparison between the processing speed of the external apparatus de- 
tected by the processing-speed detection means and an image pickup speed or a picked-up image data output 
speed of the image pickup unit, and varying control means tor varying an image pickup action or a picked-up image 
data output action of the image pickup unit according to a result of the comparison made by the speed comparison 

10 means or according to an operation performed by an operator of the Image pickup system. 

(2) An image pickup system is arranged to include, in addition to the arrangement of the system defined by Para. 

(I) above, informing means for informing one of or all of the operator of the image pickup system, the external 
apparatus and the image pickup unit of the result of the comparison made by the speed comparison means. 

(3) An image pickup system Is arranged to Include, in addition to the arrangement of the system defined by Para. 
15 (1 ) or (2) above, Dm detection means for measuring or predicting a maximum amount Dm of ptcked-up image data 

transferable per unit time to the external apparatus connected, and data amount comparison means for making a 
comparison between the detected maximum amount Dm of picked-up image data and an amount Sp of picked- 
up image data being outputted per unit time by the image pickup unit. 

(4) An Image pickup system Is arranged to Include, in addition to the arrangement of the system defined by Para. 
20 (1) or (3) above, operation clock detection means for measuring or predicting an operation clock speed of the 

external apparatus. In the system, the speed comparison means compares the image pickup speed of the image 
pickup unit with the operation clock speed of the extemal apparatus measured or predicted by the operation clock 
detection means. 

(5) In the image pickup system defined by any one of Para. (1 ) to (4) above, when the image pickup unit obtains 
25 a plurality of pixel data, the varying control means selects and outputs at least one pixel data from among the 

plurality of pixel data. 

(6) In the image pickup system defined by any one of Para. (1 ) to (5) above, the varying control means is arranged 
to vary the number of frames of images to be picked up per unit time by the Image pickup unit. 

(7) In the image pickup system defined by any one of Para. (1 ) to (6) above, the varying control means Is arranged 
30 to select and output picked-up Image data for at least one picture from arrrong picked-up Image data for a plurality 

of pictures being sent out at intervals of a predetermined length of time from the image pickup unit. 

(8) In the image pickup system defined by any one of Para. (1) to (7) above, when the image pickup unit obtains 
picked-up Image data for one frame composed of a plurality of pixel rows, the varying control means selects and 
outputs pIcked-up image data for a fewer number of pixel rows than the plurality of pixel rows. 

35 (9) In the image pickup system defined by any one of Para. (1) to (8) above, when the image pickup unit obtains 

picked-up image data for one frame composed of a plural number of colors, the varying control means selects and 
outputs data for an arbitrary number of colors from among the picked-up image data. 

(1 0) In the image pickup system defined by any one of Para. (1 ) to (9) above, the varying control means Is arranged 
to increase or decrease an amount of information carried by each of pixels with which the Image pickup unit forms 

40 the picked-up image data. 

(I I ) An image pickup system is composed of an image pickup unit which has a connection terminal for connection 
with an external apparatus and which is arranged to pick up an image to output picked-up image data from the 
connection terminal and at least one external apparatus which Is connected to the image pickup unit. The image 
pickup unit comprises data exchange means for exchanging data with the external apparatus connected, compar- 

45 ison means for making a comparison between an image displaying method of the external apparatus and an image 

pickup method of the image pickup unit, and varying control means for varying an image pickup action or a picked- 
up image data output action of the image pickup unit according to a result of the comparison made by the com- 
parison means or according to an operation performed by an operator of the image pickup system. 

(12) An image pickup system is arranged to include, in addition to the arrangement of the system defined by Para. 
so (11) above, display varying means for varying the image displaying method of the external apparatus according 

to the result of the comparison made by the comparison means or according to the operation performed by the 
operator of the image pickup system. 

(13) An image pickup system is arranged to include, in addition to the arrangement of the system defined by Para. 

(11) above, informing means for informing one of or all of the operator of the image pickup system, the external 
55 apparatus and the image pickup unit of the result of the comparison made by the comparison means. 

(14) In the image pickup system defined by anyone of Para. (11) to (13) above, when the image pickup unit obtains 
a plurality of pixel data, the varying control means selects and outputs at least one pixel data from among the 
plurality of pixel data. 
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(15) In the image pickup system defined by any one of Para. (11) to (14) above, tlie varying control means is 
arranged to vary the number of frames of images to be picked up per unit time by the image pickup unit. 

(16) In the image pickup system defined by any one of Para. (11) to (15) above, the varying control means is 
arranged to select and output picked-up image data for at least one picture from among picked-up image data for 

s a plurality of pictures being sent out at intervals of a predetermined length of time from the image pickup unit. 

(1 7) In the image pickup system defined by any one of Para. (11 ) to (1 6) above, when the image pickup unit obtains 
picked-up image data for one frame composed of a plurality of pixel rows, the varying control means selects and 
outputs picked-up image data for a fewer number of pixel rows than the plurality of pixel rows. 

(18) In the image pickup system defined by any one of Para. (11 ) to (17) above, when the image pickup unit obtains 
10 picked-up image data for one frame composed of a plural number of colors, the varying control means selects and 

outputs data for an art)itrary number of colors from among the picked-up image data. 

(19) In the image pickup system defined by any one of Para. (11) to (18) above, the varying control means is 
arranged to increase or decrease an amount of information carried by each of pixels with which the image pickup 
unit forms the picked-up image data. 

15 (20) In the image pickup system defined by Para. (11), the image pickup unit includes display speed detection 

means for detecting or predicting a display speed of an image display device included in the external apparatus 
connected. 

(21) In the image pickup system defined by Para. (11), the image pickup unit includes resolution detection means 
for detecting or predicting a resolution of an image display device included in the extemal apparatus connected. 
20 (22) In the image pickup system defined by Para. (11), the image pickup unit includes color information amount 

detection means for detecting or predicting an amount of color informatbn to be displayed by an image display 
device included in the extemal apparatus connected. 

(23) An image pickup unit comprises image pickup means for picking up an optical image to form a picked-up 
image signal, communication means for performing communication with an external signal processing apparatus, 

25 and control means for receiving infornoation on a processing capability characteristic of the external signal process- 

ing apparatus and changing an image pickup mode of the image pickup means on the basis of the information on 
the processing capability characteristic. 

(24) The image pickup unit defined by Para. (23) above is arranged to be removably attachable to the external 
signal processing apparatus. 

50 (25) In the image pickup unit defined by Para. (23) above, the control means is arranged to receive infomnation 

on an internal operation speed of the external signal processing apparatus. 

(26) In the image prckup unit defined by Para. (23) above, the control means is arranged to receive information 
on a display capability of a display device included in the extemal signal processing apparatus. 

(27) In the image pickup unit defined by Para. (23) atx>ve, the control means is arranged to change the image 
35 pickup mode by changing an amount of information per unit time of the picked-up image signal to be formed by 

the image pickup means. 

(28) In the image pickup unit defined by Para. (23) above, the control means is arranged to change the image 
pickup mode by changing an amount of color informatkjn of the picked-up image signal to be formed by the image 
pickup means. 

40 (29) A picked-up image signal processing apparatus comprises communication means for performing communi- 

cation with an image pickup unit including image pickup means for picking up an optical image to form a picked- 
up image signal, and control means for transmitting to the image pickup unit a processing capability characteristic 
of signal processing means included in the picked-up image signal processing apparatus and controlling and 
changing an image pickup mode of the image pickup means included in the image pickup unit according to the 

45 processing capability characteristic of the signal processing means. 

(30) In the picked-up image signal processing apparatus defined by Para. (29) above, the image pickup unit is 
arranged to be removably attachable to the picked-up image signal processing apparatus. 

(31 ) In the picked-up image signal processing apparatus defined by Para. (29) above, the control means is arranged 
to transmit information on an operation speed of the signal processing means to the image pickup unit. 

50 (32) In the picked-up image signal processing apparatus defined by Para. (29) above, the control means is arranged 

to transmit information on a display capability of the signal processing means to the image pickup unit. 
(33) In the picked-up image signal processing apparatus defined by Para. (29) above, the control means is arranged 
to change the image pickup mode by changing an amount of information per unit time of the picked-up image 
signal to be formed by the image pickup unit. 

55 (34) In the picked-up image signal processing apparatus defined by Para. (29) above, the control means is arranged 

to change the image pickup mode by changing an amount of color information of the picked-up image signal to 
be formed by the image pickup unit. 
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Preferred embodiments of the invention are provided by the arrangements described above. 

Further, in an image pickup system composed of at least one computer which has at least one connection terminal 
and at least one image pickup unit which is detachably connectable to the connection terminal, the image pickup unit 
connected to the connection terminal of the computer comprises means for exchanging data with the computer, means 
s for measuring or predicting a processing speed of the computer, means for making a comparison between the process- 
ing speed and an image pickup speed of the image pickup unit, and means for varying an image pickup action of the 
image pickup unit according to a result of the comparison. 

Further, in an image pickup system composed of at least one computer which has at least one connection terminal 
and at least one image pickup unit which is detachably connectable to the connection terminal, the image pickup unit 
10 connected to the connection terminal of the computer comprises means for exchanging data with the computer, means 
for making a comparison between an image display method of the computer and an image pickup method of the image 
pickup unit, and means for varying an image pickup actbn of the image pickup unit according to a result of the com- 
parison. 

The provision of these means arranged according to the invention enables the image pickup system to fully utilize 
the features and perfornnance of the computer and also to solve the problems resulting from differences relative to the 
data processing speed and the display device of the computer. 

The above and further advantages and features of the invention will become apparent from the following detailed 
description of embodiments thereof taken in conjunction with the accompanying drawings. 

20 Brief Description of the Drawings: 

Fig. 1 is a block diagram showing the arrangement of a first embodiment of the invention. 
Fig. 2 is a block diagram showing the arrangement of an image pickup unit of the first embodiment. 
Fig. 3 is a flow chart showing an image pickup operation for one frame in the first embodiment. 
25 Fig. 4 is a flow chart showing a moving image pickup routine A in the first embodiment. 

Fig. 5 is a flow chart showing a moving image pickup routine B in the first embodiment. 

Fig. 6 is a flow chart showing an image pickup operatbn of a third embodiment of this invention. 

Fig. 7 is a block diagram showing by way of example the conventional image pickup system. 

30 Detailed Description of the Preferred Embodiments: 

Preferred Embodiments of the invention are described below with reference to the drawings. 

(First Embodiment) 

35 

A first embodiment of the invention is described with reference to Figs. 1 and 2 as follows. 

Fig. 1 is a block diagram showing an image pickup system arranged according to the invention as the first embod- 
iment of the invention. Fig. 2 is a block diagram showing an image pickup unit of the first embodiment. 

Referring to Fig. 1 , the illustration includes an image pickup unit 1 , a device unit 2 which is of connection specifi- 
40 cations equivalent to those of the image pickup unit 1 , a computer 3, a CPU 4 of the computer 3, connection terminals 
5 and 6 of the computer 3, a display device 7 of the computer 3, a memory device 8 of the computer 3, and an operation 
program 9 of the CPU 4. 

Referring to Fig. 2 which shows in a block diagram the arrangement of the image pickup unit 1, the illustration 
includes a lens unit 10, a CCD 11 , an A/D converter 12, a digital signal processing device (DSP) 13, a FIFO memory 
45 14, a lens controller 15 which controls the lens unit 10 and includes an automatic focusing device and an automatic 
image stabilizing (image-shake preventing) device which are known, a timing generator (TG) 16 arranged to send out 
timing pulses to the CCD 11 and the A/D converter 12, a control unit 17 disposed within the image pickup unit 1. an 
interface (camera l/F) 1 8 provided for extemal connection, a light unit 1 9 arranged at the image pickup unit 1 to illuminate 
an object of shooting, and a counter 20 arranged to divide the frequency of input clock pulses and outputs frequency- 
50 divided clock pulses (to be used in a second embodiment). 

The innage pickup system picks up images with the image pickup unit 1 connected to the computer 3. 

(Pickup of Still Image) 

55 An operation of picking up an image for one frame is first described with reference to Figs. 1 and 2 and Fig. 3 

which is a flow chart. The control unit 17 of the image pickup unit 1 controls this operation, \ferious control actions 
performed at steps S11 to S17 shown in Fig. 3 will be described. 

At the step 811 , the control unit 17 causes the CCD 11 to measure the luminance of an object of shooting. After 
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that, the light unit 1 9 is controlled to illuminate the object to give a condition best suited for taking a shot. 

At the step SI 2, the lens unit 10 is caused through the lens controller 15 to perform a focusing action. The image 
stabilizing device is also used if necessary. 

At the step SI 3, image information for one frame is stored as electric charge at the CCD 11 through the lens unit 
s 10. This control is performed by the control unit 1 7. The timing of reading from the CCD 11 Is decided by timing pulses 
sent from the TG 16. The electric charge storing time of the CCD 11 Is decided by the control unit 17 according to the 
luminance of the object obtained at the step S11 . 

At the step 814, the A/D converter 12 is caused to read out image data for one frame stored at the CCD 11. A 
digital image signal obtained by the A/D converter 12 is supplied to the DSP 13 to be converted into a Y (luminance) 
10 signal and color-difference signals. These signals are converted further into R, G and B signals. The A/D converting 
speed of the A/D converter 12 and the operation of the CCD 11 are decided by the timing pulses sent from the TG 16. 
The TG 16 has different operation pulse output modes including a mode 0 to a mode 3. 

In the mode 0, a signal for one frame is taken in every time a control signal is received from the control unit 17. In 
the mode 1, operation pulses are sent to the CCD 11 and the A/D converter 12 in such a way as to cause picked-up 
^5 image data for five frames to be outputted per sec from the DSP 13. In the mode 2, operation pulses are sent to the 
CCD 11 and the A/D converter 12 in such a way as to cause picked-up image data for fifteen frames to be outputted 
per sec from the DSP 1 3. In the nrKxJe 3, operation pulses are sent to the CCD 11 and the A/D converter 12 in such a 
way as to cause picked-up image data for thirty frames to be outputted per sec from the DSP 13. In the case of Fig. 
3, the flow of operation is assumed to be executed in the mode 0. 
20 At the step SI 5, the DSP 1 3 is caused to process the output of the A/D converter 1 2. In this case, the Y and color- 

difference signals are converted into R, G and B signals. The DSP 13 has R, G and B outputs. From these outputs, 
the R, G and B signals are simultaneously outputted at a time on a line-by-line basis. In this case, one frame consists 
of 250 lines. 

At the step SI 6, signals outputted from the DSP 1 3 are temporarily stored in the FIFO memory 14, which has a 
25 storage capacity of three frames. 

At the step SI 7, the signals are read out from the Fl FO memory 1 4 and sent to the computer 3 through the interface 

18. 

A still image for one frame can be obtained through the steps S11 to SI 7 described above. 
In the computer 3, the inriage data obtained from the image pickup unit 1 is displayed on the display device 7 and, 
30 at the same time, is stored in the menrrary device 8. If necessary, the computer 3 transfers the image data to the device 
unit 2. The operation of the computer 3 is decided by the operation program 9. 

(Pickup of Moving Image) 

35 In the case of this embodiment, the image pickup system is capable of taking a moving image by continuously 

taking still images as described above. The moving image taking operation is next described below with reference to 
Figs. 1 , 2. 4 and 5. 

In taking a moving innage, the flow of operation of the image pickup system is divided into a routine A and a routine 
B. In the routine A, picked-up image data read out from the CCD 11 is continuously written into the FIFO memory 14. 
40 In the routine B, the picked-up innage data is read out from the FIFO mennory 14 and is sent out continuously to the 
computer 3 through the interface 18. The control unit 17 simultaneously executes the routine A and the routine B. By 
perfonming the routine A and the routine B, an image pickup operation can be carried on In a manner suited to the 
processing speed of the computer 3. The routine A is as shown in a flow chart in Fig. 4, while the routine B is shown 
also in a flowchart in Fig. 5. 
45 The routine A is first described with reference to Figs. 1 , 2 and 4 as follows. 

At a step S21, the routine A begins. The following actions are all executed by the control unit 17. 

At a step S22, picked-up image data for one frame is obtained in the same manner as the still image taking pro- 
cedures described above. The image data thus obtained is stored in the FIFO memory 14. 

At a step S23. a check is made for a vacancy in the storage capacity of the FIFO memory 14. The FIFO memory 
so 1 4 of the image pickup unit 1 is capable of storing image data for three frames. When image data for three frames has 
been written in the FIFO memory 14, the FIFO memory sends a flow signal to the control unit 17. The control unit 17 
can find if there is a vacancy in the FIFO memory 14 through the flow signal. 

Since the control unit 17 is arranged to execute both the routine A which is for writing into the FIFO memory 14 
and the routine B which is for reading from the FIFO memory 14, the flow signal being sent from the FIFO memory 14 
55 indicates that the action of reading from the FIFO memory 1 4 is slower than the action of writing into the FIFO memory 
14. In other words, in such a case, the amount of image data picked up per unit time is larger than that of image data 
processed by the computer 3. Then, in this case, it is necessary to decrease the amount of image data picked up per 
unit time. 
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If the flow signal is detected at the step S23, the flow comes to a step S26. If not, the flow comes to a step S24. 

At the step S24, a check is made to find If a request for stopping the Image pickup operation is received from the 
computer 3. If so, the flow comes to a step S25. If not, the flow comes back to the step S22 to continue the image 
pickup operation. 

5 At the step S25, the routine A comes to an end. The inoage pickup operation at the CCD 11 is brought to a stop. 

At the same time, the lens unit 10, the CCD 11, the A/D converter 12, the DSP 13, the lens controller 15, the TG 16 
and the light unit 1 9 stop from operating. 

When the flow proceeds to the step S26, there are two modes for decreasing the amount of image data to be 
picked up per unit time. In one mode, the operator of the image pickup system decides to decrease the amount of 

10 image data picked up per unit time and gives an instruction for the execution of the decision. In the other mode, the 
image pickup unit 1 automatically decreases the amount of image data picked up per unit time. A choice between the 
two methods is set in the program 9 beforehand. In the case of the instruction from the operator, the flow comes to a 
step S27. In the case of the automatic execution by the image pickup unit 1 , the flow proceeds to a step S28. 

At the step S27, the current output mode of the TG 16 is changed by the operator to another mode which gives a 

IS suitable value among the output modes of the TG 16 mentioned in the foregoing description of the step SI 4 of the still 
image taking operation. As a result of the operation by the operator, the amount of picked-up image data to be sent 
out per unit time from the image pickup unit 1 to the computer 3 decreases. The flow then comes from the step 827 
to a step S31 . 

At the step S28, the number of the output mode of the TG 16 mentioned in the foregoing description of the step 
20 SI 4 of the still image taking operation is decremented by one. In other words, with the current output mode of the TG 
16 assumed to be the mode 3, the mode 3 is changed over to the mode 2. This change causes the annount of picked- 
up image data per unit time to decrease. Incidentally, the initial value of the mode is 3. 

The image pickup unit 1 informs the computer 3 of the above-stated action when the output mode of the TG 16 is 
lowered. The computer 3 then displays this action on the display device 7. 
25 At a step S29, a check is made to find if the output mode of the TG 16 has become the mode 0. If so, the mode 0 

indicates that no moving innage can be taken by the image pickup system. This result of check is obtained in a case 
where the picked-up image data reading speed of the computer 3 has lowered or when it is incapable of reading the 
data. If the output mode of the TG 16 is found to be the mode 0, the flow comes to a step S30. If not, the flow comes 
to the step S31 . 

30 At the step S30, an error processing action to be carried out in the event of the mode 0 is executed. The control 

unit 17 informs the computer 3 that the nnoving image taking action is impossible, and the flow comes to a step S25 
to bring the routine A to an end. 

At the step S31 , the data currently stored in the FIFO memory 14 is read out by the routine B and a check is made 
for any vacancy in the storage capacity of the FIFO memory 1 4. If the flow signal is detected, the flow comes to a step 
3S S32. If not, the flow comes to the step S22. 

At the step S32, the operation is suspended for a predetermined period of time. After that, the flow comes to the 
step S31 again to make a check for any vacancy in the storage capacity of the FIFO memory 14. 
The routine B is next described with reference to Figs. 1 , 2 and 5 as follows. 
At a step S41, the routine B begins. The following actions are all executed by the control unit 17: 
40 At a step S42, a check is made for the state of the FIFO memory 14. The FIFO memory 14 sends an empty' signal 

to the control unit 17 if it has no picked-up image data stored there at all. If the empty signal is detected, the flow comes 
to a step S43. If not, the flow comes to a step S47. 

At the step S43, the flow of operation is suspended for a predetermined period of time to wait until the picked-up 
image data is stored in the FIFO memory 14. 
45 At a step S44, check is made for a state of error. In other words, in a case where the action of the step S43 continues 

to a predetenmined extent without executing the action of the step S47, this state indicates that the image pickup 
operation according to the routine A has not been performed at all. If this state is detected, the flow comes to a step 
S45. If not, the flow comes back to the step S42. 

At the step S45, the error processing action is performed. The computer 3 is informed that the image pickup 
50 operation cannot be continued due to occurrence of an error After the step S45, the flow comes to a step S46 to bring 
the routine B to an end. 

When the flow comes from the step 842 to the step S47, the picked-up image data stored in the FIFO memory 14 
is read out. 

At a step S48, the picked-up image data read out at the step 847 is sent out to the computer 3. 

55 

(Second Embodiment) 

An image pickup system which is a second embodiment of the invention is arranged in the same manner as the 
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first embodiment and as shown in Figs. 1 and 2. The operation of the second embodiment in each part is, however, 
not exactly the same as in the first embodiment. The still image taking operation of the second embodiment is the same 
as that of the first embodiment described in the foregoing. Therefore, the following description of the second embod- 
iment omrts its still image taking operation and covers only its moving image taking operation. 

5 

(Pickup of Moving Image) 

When the image pickup unit 1 is connected to the computer 3, the image pickup unit 1 receives through the interface 
18 an operation clock signal CIkO from the computer 3. The operation clock signal CIkO is of a frequency which is 
10 proportional to the processing speed of the computer 3. The operation clock signal CIkO is inputted to the counter 20 
from the interface (l/F) 18, The counter 20 is provided with a means for detecting the frequency Fc of the operation 
clock signal CIkO. Information on the frequency Fc detected is sent to the control unit 17. 

The counter 20 receives from the control unit 17 a signal Oc which has a higher frequency than the signal CIkO 
and uses it In measuring the frequency Fc. The frequency Fc of the signal CIkO is measured by counting a number of 
15 times for which the signal Oc varies in one cycle of the signal CIkO. Information on the measured frequency Fc is stored 
at the control unit 17. If the' intrinsic frequency Fc of the computer 3 Is known, the value of the intrinsic frequency Fc 
may be stored beforehand at the control unit 17. 

Then, the control unit 17 compares the frequency Fc with the output mode of the TG 16 which is arranged as 
mentioned at the step SI 4 of the foregoing description of the still image taking operation of the first embodiment. The 
20 output mode of the TG 16 is changed over to another output mode according to the result of the comparison. 

The amount of image data picked up per unit time by the image pickup unit 1 can be adjusted to the processing 
speed of the computer 3 by this operation. 

(Third Embodiment) 

2S 

An image pickup system which is a third embodiment of the invention Is described with reference to Figs. 1 , 2 and 
6 as follows. The image pickup system is arranged in the same manner as the first embodiment described in the 
foregoing. However, its operation in each part differs from that of the first embodiment. 

The image pickup unit 1 is connected to the computer 3 as shown in Figs. 1 and 2. Then, the CPU 4 sends 
30 information on the display method of the display device 7 to the control unit 17. The control unit 17, which has stored 
information on an image pickup method used before, sends the information to the CPU 4. 

The display method of the display device 7 is assumed to be as follows. 

Resolution: 320 horizontal pixels and 

35 240 vertical pixels per frame 

Display speed: 1 0 frames per sec 

Amount of information of one pixel: 8 bits, 

monochrome 

40 The operation of the image pickup system which is the third embodiment of the invention is described with reference 

to the flow chart of Fig. 6 as follows. 

At a step S51 , the CPU 4 makes a comparison between the image pickup method of the Image pickup unit 1 and 
the display method of the display device 7. Here, the image pickup method of the image pickup unit 1 is assumed to 
be as follows. 

45 

Resolution: 

Image pickup speed: 
Amount of information of one pixel 

50 

The CPU 4 informs the operator of the image pickup system of the display method of the display device 7 and the 
image pickup method of the image pickup unit 1 . 

At a step S52, depending on whether the operation is performed by the operation program 9 or by the operator of 
the Image pickup system, either of the following actions (a) and (b) is selected. 

55 

(a) The image pickup method of the image pickup unit 1 is matched to the display method of the display device 7. 

(b) The display method of the display device7 is matched to the innage pbkup method of the image pickup unit 1 . 



640 horizontal pixels and 
480 vertical pixels per frame 
30 frames per sec 

color, 8 bits for each of colors R, G and B, 24 bits in all 
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If the display method of the display device 7 is fixed, the action (a) is selected and the flow connes to a step S53. 
If the action (b) is selected, the flow comes to a step S56. 

At the step S53, the DSP 13 performs a processing to match the number of pixels of the picked-up image data 
outputted from the image pickup unit 1 to the display method of the display device 7. Since the number of pixels of the 
s picked-up image data is larger than the number of pixels that can be displayed by the display device 7 in this instance, 
the numbers of pixels both in the vertical and horizontal directions are respectively reduced to one half. 

At a step S54, the DSP 13 causes the amount of information carried by each pixel of the picked-up image data to 
be matched to the amount of information that can be displayed by the display device 7. In the case of this embodiment, 
the display device 7 is capable of displaying only in monochrome and the amount of information of each pixel of it is 
10 only 8 bits. The amount of information of each pixel of the picked-up image data is, on the other hand, 24 bits. In this 
case, therefore, only the data of color G (8 bits) of the picked-up image data is sent to the display device 7. 

At a step S55. the DSP 1 3 causes the frame speed of the picked-up image data to be matched to the display speed 
of the display device 7. Since the display speed of the display device 7 is 10 frames/sec while the image pickup speed 
of the image pickup unit 1 is 30 frames/sec in this case, picked-up image data of one of every three frames is selected 
15 and sent to the display device 7. 

At the step S56, the display method of the display devrce 7 is matched to the image pickup method of the image 
pickup unit 1 . It might be impossible to display the whole amount of information carried by the picked-up image data. 
However, this action (b) is selectable in a case where, for example, the whole picked-up image data Is stored In the 
memory device 8 without displaying the picked-up image data in its entirety. 
20 The flow of operation comes to an end at a step S57. 

The image pickup method of the image pickup unit 1 is matched to the display method of the display device 7 by 
the steps S51 through S56. After completion of the matching process, the image pickup unit 1 is allowed to perform 
the image pickup operation. 

As apparent from the foregoing description, a means for controlling the image pickup mode of the image pbkup 
25 unit 1 may be disposed either within the image pickup unit 1 or on the side of the computer 3 which is serving as an 
external picked-up image signal processing means. 

According to the arrangement of the embodiments described above, the function of processing the picked-up 
image signal formed by the image pickup unit and the function of controlling the image pickup operation are arranged 
to be performed in part within the external picked-up image signal processing apparatus. The arrangement, therefore, 
30 permits reductbn of the size of the image pickup unit, so that the image pickup unit can be formed in a card-like shape, 
such as a card of the PCMCIA standards, like in the case of the embodiments described above. 

The conventional method of processing a picked-up image signal with a computer or the like has necessitated a 
process of converting the picked-up image signal into a signal conforming to the television format of the NTSC system 
or the like before converting it into a digital signal for the computer. The conventional method thus involves some 
35 duplicating part in processing the signal. Such wasteful process can be avoided according to the arrangement of the 
embodiments described above. 

Further, according to the arrangement of the embodiments of the invention, an image pickup function can be added 
to a signal processing apparatus such as a computer without necessitating any complex arrangement. 

It is particularly advantageous feature of the image pickup system that the capability of the image pickup unit is 
"^0 adjusted to the signal processing capability such as the signal processing speed and the display capability of the signal 
processing apparatus. In accordance with the invention, therefore, the signal processing operation can be optimized 
to eliminate any wasteful process. The invention, therefore, gives a system which processes signals at an optimum 
speed and also reduces the power consumption of the whole system. 

45 

Claims 

1. An image pickup system composed of an image pickup unit which has a connection terminal for connection with 
an external apparatus and which is arranged to pick up an image to output picked-up image data from the con- 
50 nection terminal and at least one external apparatus which is connected to said inriage pickup unit. 

said image pickup unit comprising: 

data exchange means for exchanging data with said external apparatus connected; 
processing-speed detection means for measuring or predicting a processing speed of said external apparatus 
55 connected; 

speed comparison means for making a comparison between the processing speed of said external apparatus 
detected by said processing-speed detection means and an image pickup speed or a picked-up image data 
output speed of said image pickup unit; and 
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varying control means for varying an image pickup action or a picked-up image data output action of said 
image pickup unit according to a result of the comparison made by said speed comparison means or according 
to an operatbn performed by an operator of said image pickup system. 

2. A system according to claim 1 , further comprising Dm detection means for measuring or predicting a maximum 
amount (Dm) of picked-up image data transferable per unit time to said external apparatus connected, and data 
amount comparison means for making a comparison between the detected maximum amount (Dm) of picked-up 
image data and an amount (Sp) of picked-up image data being outputted per unit time by said image pickup unit. 

3. A system according to claim 1 or claim 2, further comprising operation clock detection means for measuring or 
predicting an operation clock speed of said external apparatus, and wherein said speed comparison means is 
arranged to compare the image pickup speed of said image pickup unit with the operation clock speed of said 
external apparatus measured or predicted by said operation clock detection means. 

4. An image pickup system composed of an image pickup unit which has a connection terminal for connection with 
an external apparatus and which is arranged to pick up an innage to output picked-up image data from the con- 
nection terminal and at least one external apparatus which is connected to said image pickup unit, 

said innage pickup unit comprising: 

data exchange means for exchanging data with said extemal apparatus connected; 

comparison means for making a comparison between an innage displaying method of said extemal apparatus 
and an image pickup method of said image pickup unit; and 

varying control means for varying an image pickup action or a picked-up image data output action of said 
image pickup unit according to a result of the comparison made by said comparison means or according to 
an operation performed by an operator of said image pickup system. 

5. A system according to claim 4. further comprising display varying means for varying the Image displaying method 
of said extemal apparatus according to the result of the comparison made by said comparison means or according 
to the operation performed by the operator of said image pickup system. 

6. A system according to claim 1 or claim 4, further comprising informing means for informing one or all of the operator 
of said Image pickup system, said extemal apparatus and said image pickup unit of the result of the comparison 
made by said comparison means. 

7. A system according to any one of claims 1 or 4 to 6, wherein, when said image pickup unit obtains a plurality of 
pixel data, said varying control means selects and outputs at least one pixel data from among the plurality of pixel 
data. 

8. A system according to any one of claims 1 or 4 to 7, wherein said varying control means is arranged to vary the 
number of frames of images to be picked up per unit time by said image pickup unit. 

9. A system according to any one of claims 1 or 4 to 8, wherein said varying control means is arranged to select and 
output picked-up image data for at least one picture from among picked-up image data for a plurality of pictures 
being sent out at intervals of a predetermined length of time from said image pickup unit. 

10. A system according to any one of claims 1 or 4 to 9, wherein, when said image pickup unit obtains picked-up image 
data for one frame composed of a plurality of pixel rows, said varying control means selects and outputs picked- 
up image data for a fewer number of pixel rows than the plurality of pixel rows. 

11. A system according to any one of claims 1 or 4 to 10, wherein, when said image pickup unit obtains picked-up 
innage data for one frame composed of a plural number of colors, said varying control means selects and outputs 
data for an arbitrary number of colors from among the picked-up image data. 

12. A system according to any one of claims 1 or 4 to 11 , wherein said varying control means is arranged to increase 
or decrease an amount of information carried by each of pixels with which said image pickup unit forms the picked- 
up image data. 

13. A system according to claim 4, wherein said image pickup unit further includes display speed detection means for 
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detecting or predicting a display speed of an image display device included in said external apparatus connected. 

14. A system according to claim 4, wherein said innage pickup unit further includes resolution detection means for 
detecting or predicting a resolution of an image display device included in said extemal apparatus connected. 

5 

15. A system according to claim 4, wherein said image pickup unit further includes color information amount detection 
means for detecting or predicting an amount of color information to be displayed by an image display device 
included in said external apparatus connected. 

10 16. An image pickup unit comprising: 

innage pickup means for picking up an optical image to form a picked-up image signal; 
communication means for performing communication with an extemal signal processing apparatus; and 
control means for receiving informatbn on a processing capability characteristic of said external signal 
15 processing apparatus and changing an image pickup mode of said image pickup means on the basis of the 

information on the processing capability characteristic. 

17. A unit according to claim 1 6, wherein said image pickup unit is arranged to be removably attachable to said extemal 
signal processing apparatus. 

20 

18. A unit according to claim 1 6, wherein said control means is arranged to receive infornnation on an internal operation 
speed of said extemal signal processing apparatus. 

19. A unit according to claim 1 6, wherein said control means Is arranged to receive information on a display capability 
25 of a display device included in said external signal processing apparatus. 

20. A unit according to claim 1 6, wherein said control means is arranged to change the image pickup mode by changing 
an amount of Information per unit time of the picked-up image signal to be formed by said image pickup means. 

30 21 . A unit according to claim 1 6, wherein said control means is arranged to change the image pickup mode by changing 
an amount of color information of the picked-up image signal to be formed by said Image pickup means. 

22. A pIcked-up image signal processing apparatus comprising: 

35 communication means for performing communication with an image pickup unit Including image pickup means 

for picking up an optical image to form a picked-up image signal; and 

control means for transmitting to said image pickup unit a processing capability characteristic of signal process- 
ing means Included in said picked-up image signal processing apparatus and for controlling an image pickup 
mode of said image pickup means included in said image pickup unit according to the processing capability 
40 characteristic of said signal processing means. 

23. An apparatus according to claim 22, wherein said Image pk:kup unit is arranged to be removably attachable to 
said picked-up image signal processing apparatus. 

45 24. An apparatus according to claim 22, wherein said control means is arranged to transmit information on an operation 
speed of said signal processing means to said image pickup unit. 

25. An apparatus according to claim 23, wherein said control means is arranged to transmit information on a display 
capability of said signal processing means to said image pickup unit. 

50 

26. An apparatus according to claim 23, wherein said control means is arranged to change the image pickup mode 
by changing an amount of information per unit time of the picked-up image signal to be formed by said image 
pickup unit. 

55 27. An apparatus according to claim 23, wherein said control means is arranged to change the image pickup mode 
by changing an amount of color information of the picked-up image signal to be formed by said image pickup unit. 
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